78 


ISSN 1822-1645 

http://dx.doi.Org/10.7720/1822-1645.10.4 


Edith J. CISNER0S-C0HERN0UR 

Yucatano autonominis universitetas 
Autonomous University of Yucatan 


ISSUKIAI, SU KURIAIS 
SUSIDURIAMA 
STANDARTIZUOTU 
METODU VERTINANT 
DESTYMO 
UNIVERSITETUOSE KOKYBt; 


CHALLENGES WHEN 
USING A STANDARDIZED 
APPROACH FOR ASSESSING 
THE QUALITY OF COLLEGE 
TEACHING 


SANTRAUKA 

Siame straipsnyje pristatomas kokybinis atve- 
jo tyrimas, kuriame analizuotas destomas 
jvadinis kursas apie speciality 14 poreikit} stu- 
dentus. Duomenims rinkti taikyti dokumen- 
tq analizes, stebejimo ir interviu su vadovais, 
kitais fakulteto darbuotojais, destytojo kole- 
gomis, destytojo asistentais ir studentais me- 
todai. Kartu buvo jvertinta ir destymo kokybe. 
Straipsnyje aptariami privalumai ir trukumai, 
su kuriais susiduriama standartizuotu meto- 
du vertinant dalyko destymo kokyb^ pedago¬ 
gy atestacijai. Taip pat pateiktos jzvalgos apie 
studijq technologijq naudojimq ir destymo 
universitetuose jvertinimq. 


PAGRINDINigTERMINg 

APIBREZIMAI 

• Fakulteto darbuotojy. jvertinimas - aukstpjp 
mokyklp (kolegijp ir universitetp) adminis- 
tracinio ir kito akademinio personalo (des- 
tytojp, tyrejij) kompetentingumo jvertinimas, 
remiantis apibreztais kriterijais. 

• Studenty pateiktas destymo reitingas - des¬ 
tymo kokybes jvertinimas, remiantis studentp 


ABSTRACT 

This article develops around a qualitative re¬ 
search case study of an instructor teaching 
an introductory course about students with 
special needs. Data collection involved docu¬ 
ment analysis, observations and interviews 
with administrators, the faculty member, his 
peers, teaching assistants and students. The 
case is also a reflective piece on the evaluation 
of teaching quality. Benefits and obstacles to 
using a standardized approach for evaluating 
an instructor teaching a required course for 
teacher certification are discussed, and im¬ 
portant implications in the evaluation of both 
educational technology and college teaching 
are identified. 


DEFINITIONS OF KEY TERMS 

• Faculty evaluation - judging the value or 
competence of administrative, instructional, 
or other academic staff in schools, colleges, or 
universities based on established criteria. 

• Student ratings of teaching - source for 
evaluating a professor teaching based on the 
opinion of students, mainly by responding to a 
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nuomone, kuriq jie issako semestro ar studijij 
metij pabaigoje pateiktose apklausose. 

• Standartizuotas jvertinimas - standartq 
atitinkantis jvertinimo tipas. Pagal jj visi des- 
tomieji dalykai vertinami tuo paciu principu, 
nekreipiant demesio j kontekstq arba jam ski- 
riant mazai demesio. 

• Destymas - kitij asmenij mokymo ar ins- 
truktavimo veikla. 

• Studijij technologija - sistemingas studijq is- 
teklirj identifikavimas, pletra, organizavimas ir 
naudojimas ir (ar) sip procesij valdymas. Kar- 
tais pateikiama siauresne sio termino reiks- 
me - audiovizualiniij priemoniij ir technines 
jrangos naudojamas studijij aplinkoje. 

• Zmonhf. jvairove - etniniai ir kulturiniai 
zmoniij skirtumai. 


jVADAS 

Del Jungtinese Amerikos Valstijose nuolat di- 
dejancios rasines ir etnines jvairoves, desty¬ 
mas susiduria su naujais issukiais. Ne isimtis 
ir jstaigos, rengiancios busimuosius mokyto- 
jus. JAV surasymo biuro duomenimis, Ame- 
rika „smarkiai seneja ir pasizymi vis didesne 
rasine bei etnine jvairove“ (Bernstein, 2012, 
p. 1). Nemazai studentij turi specialiijjij po- 
reikiij, tad pirmiausia reikia pripazinti jij rasi¬ 
ng ir etnin^ ivairovij. Siekiant suteikti daugiau 
studijij galimybiij, skatinti lygyby ir gerinti 
daugiakulturj svietimtj, Midwesterno uni- 
versitete parengti nauji kursai busimiesiems 
mokytojams. 

Straipsnyje pristatyti issukiai, su kuriais 
destytojas susidure skaitydamas jvadinj kur- 
s^ apie isskirtiniij studentij poreikius. Taip 
pat pateikti universiteto jvertinimo sistemos, 
naudotos destymo kokybei jvertinti, truku- 
mai. Be to, kalbama apie universitete nau- 
dojamos jvertinimo sistemos apribojimus, 
kurie isryskeja susitelkus j destymo kokyb^. 


survey administered at the end of an academic 
semester or academic year. 

• Standardized evaluation - a type of evalua¬ 
tion that conform to a standard. In this kind 
of evaluation the same assessment is given in 
the same manner for those being evaluated, 
with little or no attention to their particular 
context. 

• Teaching - activity of educating or instruct¬ 
ing others. 

• Educational Technology - systematic identi¬ 
fication, development, organization, or utiliza¬ 
tion of educational resources and/or the man¬ 
agement of these processes, occasionally used 
in a more limited sense to describe the use of 
equipment-oriented techniques or audiovisual 
aids in educational settings. 

• People diversity - variation of ethnic and cul¬ 
ture among individuals. 

INTRODUCTION 

The rapid increase of diversity in the United 
States is bringing new challenges to teaching 
at all levels, and this is no exception for insti¬ 
tutions devoted to teacher preparation. Data 
from the U.S. Census Bureau indicates America 
is becoming “considerably older and more ra¬ 
cially and ethnically diverse” (Bernstein, 2012, 
p. 1). A significant number of these students 
have special needs. A peoples first perspective 
of students with special needs demands that 
we recognize their racial and ethnic diversity. 
In an effort to provide educational opportu¬ 
nities, promote equity in the classroom, and 
enhance multicultural education, Midwestern 
University had developed new courses to pre¬ 
pare future teachers. 

This paper focuses on the challenges that 
an instructor confronted while teaching an 
introductory course on the needs of excep¬ 
tional students. The paper also addresses the 
limitations of the University’s evaluation sys¬ 
tem in representing the quality of his teaching. 
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Galiausiai aptariami Blackboard mokymo 
technology os privalumai ir trukumai destant 
pedagogy atestacijai aktualij kursy. 

Tyrimas yra aktualus, nes padeda at- 
skleisti destymo konteksto svarby. Si sritis 
pastaruoju metu placiai nagrinejama, nes 
didejantis atskaitomybes poreikis iskelia 
standartizuotij metodq naudojimy vertinant 
destymy ir studijavimy. 

Kontekstui skiriama daug demesio, nes 
butent su juo siejamas jvertinimo pagrjstu- 
mas. Pasak R. E. Stake ir M. Burke (2000), 
tinkamai jvertinti destymo kokyb^ galima 
tik atsizvelgus j jo konteksty ir visus jtakos 
turincius veiksnius. jvertinimas bus klaidin- 
gas nesistengiant istirti destymo kaip veiklos 
sudetingumo. 


1 

METODOLOGIJA 

Kokybinis atvejo tyrimo metodas pasirink- 
tas kaip holistinis metodas, nepriestaraujan- 
tis straipsnyje keliamiems klausimams. Sis 
metodas padeda geriau suprasti vykstancius 
procesus ir paties vertinimo konteksto kom- 
pleksiskumy (Patton, 1980). 

Atvejo tyrimas atliktas pagal pagrin- 
dinius klausimus ir aspektus (Stake ir kt., 
2005). Renkantis profesoriy ir destomyjj 
dalyky, labiau vadovautasi ne kriterijumi, 
„kokie kursai ir fakultetas geriausiai atspindi 
universitete dirbanciy destytojy ir destomy 
discipliny visumy?“, o „kokie aukstosios 
mokyklos destytojai gaiety padeti mums ge¬ 
riau suprasti, kaip standartizuotas jvertini¬ 
mo metodas padeda atksleisti destytojy des¬ 
tymo kokyb£?“ Teigiamos reiksmes turejo ir 
profesoriaus isreikstas noras tobulinti savo 
destymo metodus. 

Duomenys buvo renkami visy semes- 
try stebint darby auditorijoje, atliekant pu- 
siau strukturuotus ir atvirus interviu su 


In addition, it describes the benefits and ob¬ 
stacles when using Blackboard as instructional 
technology in the classroom to teach a course 
required for teacher certification. 

The study is important because it stresses 
the importance of the context in the evaluation 
of teaching, a topic that is not only current but 
strongly examined in different countries, as 
pressures for accountability are emphasizing 
the use of standardized approaches for assess¬ 
ing teaching and learning all over the world. 

Context is particularly important because 
it is related to the validity of the evaluation. As 
Stake and Burke (2000) state, the quality of 
teaching can only be properly valued in the 
context in which this takes place considering 
all influencing factors. If an effort is not made 
for examining teaching complexity, the evalu¬ 
ation is invalid. 

1 

METHODOLOGY 

A qualitative research case study approach was 
used to provide a holistic mode of inquiry that 
would be consonant to the exploration of the 
issues addressed by the study. The method se¬ 
lected allowed the understanding of the pro¬ 
cess and events taking place and the complexi¬ 
ties of the context under which the evaluation 
was conducted (Patton, 1980). 

The case study was organized around the 
main questions or issues (Stake et al, 2005). 
The criteria for selecting the professor and his 
course was less “what courses and faculty rep¬ 
resented the totality of the instructors and dis¬ 
ciplines taught in this university?” than “what 
instructors would help us understanding how 
the standardized evaluation approach rep¬ 
resented the quality of the instructors teach¬ 
ing?” The professor was also selected accord¬ 
ing to his desire to continue improving their 
instruction. 

Data were collected over a period of a se¬ 
mester through classroom observations and 
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universiteto vadovais, tarybos nariais, pro- 
fesoriumi, jo kolegomis, destytojy asistentais 
ir studentais. Stebedami darba auditorijoje 
aiskiau suvokeme naudojamus destymo sti- 
lius ir technology as bei destytojo ir studenty 
bendravimy Interviu, trukq nuo 30 min. iki 
valandos, su destytoju, kolegomis ir vadovais 
vyko jy kabinetuose. Tyreja galejo isanali- 
zuoti studenty pateiktus destytojo reitingq ir 
jvertinimy Kadangi sie jrasai laikomi priva- 
cia informacija, tam reikejo gauti visy tyrime 
dalyvavusiy pusiy sutikimy Duomeny rinki- 
mo metodai, laikas, skirtas duomenims rinkti 
tyrimo vietoje ir informacijos saltiniy jvairo- 
ve padejo geriau suprasti konteksty kuriame 
vyksta destymas. 

Siekiant stebejimy pagrjstumo atliktas 
daugiau nei vienas interviu, stebejimas ir do- 
kumenty apzvalga. Surinkta daug jvairiy pa- 
reiskimy, liudijimy, dokumenty ir stebejimo 
rezultaty. Kaip ir daugelio kokybiniy tyrimy, 
duomeny analize prasidejo dar teberenkant 
duomenis, tyrimo metu buvo galima is naujo 
apibrezti problemas. Taip pat atlikta koky- 
bine tiriamosios srities uzrasy analize. Kad 
gautus duomenis buty paprasciau analizuoti 
ir interpretuoti, tyreja suskirste juos pagal 
temas. Tiriamosios srities uzrasai analizuoti 
pagal pagrindinius klausimus. 

Sis tyrimas - didesnio tyrimo, kuriuo 
analizuotos destymo kokybes vertinimo 
reiksmes, suderinamumas ir socialines pa- 
sekmes didelio valstybinio universiteto kon- 
tekste, dalis. 


2 

INSTITUCIJA 

Tyrimas atliktas viename Jungtiniy Amerikos 
Valstijy universitete - viesojoje institucijoje, 


semi-structured and open-ended interviews 
with college administrators, board members, 
the professor, his colleagues, teacher assis¬ 
tants and students. Classroom observations 
provided an understanding of the teaching 
styles, classroom techniques and interactions 
between the instructor and the students. Inter¬ 
views with the professor, peers and adminis¬ 
trators were conducted in their private offices. 
Each interview lasted from 30 minutes to an 
hour. Student ratings and evaluation forms as 
a variety of documentary data were available 
to the researcher. Because the records are con¬ 
sidered private, access was gained after obtain¬ 
ing the consent of the parties involved in the 
study. The data collection used, the length of 
time devoted to data collection on site, and the 
use of multiple sources of evidence contrib¬ 
uted to a better understanding of the context 
under which teaching took place. 

In order to validate observations, more 
than one medium-from observation, inter¬ 
views, and document review were used. Data 
collection resulted in multiple statements, tes¬ 
timony, documents, and observations. Data 
analysis in this study as in most qualitative 
studies commenced as data collection con¬ 
tinued. Throughout the study, data analysis 
helped to redefine the issues. Field notes anal¬ 
ysis was qualitative. To organize the data in a 
form that facilitates analysis and interpreta¬ 
tion, the researcher used a thematic approach. 
The researcher analyzed her field notes by the 
key questions. 

The study was part of a larger study exam¬ 
ining the meanings, trade-offs, and the social 
consequences of the evaluation of teaching in 
the context of a large public university. 

2 

THE INSTITUTION 

The study was conducted in an American 
University, a public institution that offered 
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rengiancioje daugiau nei 27 OOO pirmosios pa- 
kopos ir daugiau nei 8 000 antrosios pakopos 
bei profesiniij studentq daugiau nei 100 disci¬ 
pline. Pasirinktas universitetas garseja funda- 
mentaliijjij ir taikomujij tyrinuj kokybe. 

Universiteto fakulteto nariai - daugiau- 
sia baltieji ne lotynij amerikieciai vyrai. Mi- 
dwesterno universiteto fakultete dirba 2 313 
darbuotojq, is jij 72,6 % - vyrai, 27,4 % - mo- 
terys. Fakulteto nariq pasiskirstymas pagal 
rasq ir etnin^ grupq tyrimo laikotarpiu buvo 
toks: 80 % baltieji ne lotynij amerikieciai, 
2,8 % - lotynij amerikieciai, 8 % - azijieciai, 
0,4 % - indenai, 2,5 % - afroamerikieciai ir 
5,2 % - tarptautiniai darbuotojai. Studentij 
pasiskirstymas pagal ras§ ir etnirnj grup^ taip 
pat panasus. Universiteto planavimo padali- 
nio duomenimis (1999), didziausia studentij 
grape - baltieji ne lotynij amerikieciai ir tik 
nedidelj procentij sudare lotynij amerikieciai, 
azijieciai, afroamerikieciai ir tarptautiniai 
studentai. 

Nuolatinis spaudimas del atskaitomybes 
padejo atskleisti didesnes universiteto pa- 
stangas destymo kokybei gerinti. Akreditavi- 
mo agentura pateike reikalavimcj, kad „visos 
akredituotos institucijos pateiktij efektyvaus 
destymo, kuris nusakytij destomus kursus ir 
programas, jrodymus“ (Akreditavimo krite- 
rijai, NCA, 2000). 

Be to, universitetas nurode: priimant 
sprendimus, susijusius su akademinio per¬ 
sonal atlyginimu, paaukstinimu pareigomis, 
etatine tarnyba ir premijomis, vienas pagrin- 
diniij kriterijij yra destymas. Akreditavimo 
ataskaitoje teigiama, kad visi etatin^ tarnybij 
pradedantys profesoriai privalo pateikti issa- 
mij savo destymo kokybes ivertinimij ir Des¬ 
tymo jvertinimo sistemos (D{S; angl. Teaching 
Evaluation System) reitingavimo rezultatus. 

Rektoriaus pranesimas apie priemimij j 
etatin^ tarnybij ir paaukstinimij pareigomis 
atskiriems padaliniams suteike galimyb^ des¬ 
tymo kokybij vertinti skirtingais metodais, 
taciau pabreze kiekybiniij duomenij svarb/j. 


instruction to more than 27,000 undergradu¬ 
ate students and to more than 8,800 graduate 
and professional students in more than 100 
disciplines. The university was well known for 
the quality of its basic and applied research. 

Faculty members at the institution were 
mostly White non-Hispanic males. Of the 
2313 faculty members working for Midwestern, 
72.6% were males and 27.4% females. Faculty 
distribution by race and ethnicity according to 
the university’s planning office at the time of 
the study were: 80 % of the faculty members 
were White non-Hispanic, 2.8% were His¬ 
panic, 8% Asian, 0.4% American Indian, 2.5 % 
African American, and 5.2% International. 
Student distribution by race and ethnicity was 
similar; according to the university planning 
office (1999) included a majority of White 
non-Hispanic students, with small percentag¬ 
es of Hispanic, Asian, African-American, and 
International students. 

The university efforts for improving 
teaching were visibly increasing as a result 
of the pressures for accountability. The ac¬ 
creditation agency required “all accredited 
institutions to provide evidence of effective 
teaching that characterize its courses and 
academic programs” (Accreditation criteria, 
NCA, 2000). 

In addition, the University increasingly 
stressed the role of teaching as a major factor in 
decisions about salary, promotion, tenure and 
the rewarding of academic personnel. Accord¬ 
ing to the accreditation report, all professors 
going for tenure needed to provide evidence of 
thorough evaluation of their teaching together 
with a summary of their Teaching Evaluation 
System (TES) rating scores. 

The Provost’s communication for tenure 
and promotion allowed departments to use 
different methods to evaluate teaching qual¬ 
ity, but gave strong emphasis to quantitative 
data. According to the 1999 Accreditation 
report, professors were required to submit in¬ 
formation from student ratings as part of their 
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1999 m. akreditavimo ataskaitoje nurodoma, 
kad pretenduodami j etatine; tarnybcj. ar pa- 
aukstinimcj pareigomis destytojai turi pateikti 
ir studenti} destytojo reitingus (Akreditavimo 
ataskaita, p. 16). 

Pasak prorektoriaus, studenti} pateikt^ 
destytoji} reitingtj. labai vertina ir universiteto 
administracijos darbuotojai: 

Daugelis administracijos darbuotoji{labiau ver¬ 
tina studentq pateikiamus destytojij reitingus, 
o ne kokybin$ informacijq apie destymq, nes 
jiems patogiau naudotis skaiciais. 

Atskirp padalinip administracija itin su- 
nerimo del zemp destytojp reitingu, palyginti 
su kitais kolegiji} ir universiteti} destytojais. 

Kai kurii} kalbinti} universiteto tarybos na- 
rip nuomone, D{S reitingai neatspindi objek- 
tyvios situacijos priimant sprendimus, susiju- 
sius su destymu ir paaukstinimu pareigomis. 
Vienas tarybos narys pastebejo: jeigu universi- 
tetas per daug orientuojasi j D{S reitingus, des¬ 
tytojai gali buti suinteresuoti daugiau demesio 
skirti tam, kad studentai buti} patenkinti, o ne 
paprasciausiai reflektuoti destymq. Sioje jstai- 
goje nebuvo akcentuojami nesutarimai, ky- 
lantys del to, kad itin daug demesio skiriama 
studenti} pateikiamiems reitingams. 

Destytojas. 

Siam tyrimui pasirinktas Nathano destomasis 
dalykas. Pries pradedamas tyrineti pereina- 
miyp paslaugij, teikiami} negali§ turintiems 
jauniems zmonems, sritj, jis 17 meti} dirbo 
Valstybineje svietimo taryboje vertintoju ir 
svietimo politikos analitiku. Neseniai pra- 
dejo eiti administracines pareigas. Nathanas 
turi svietimo psichologijos daktaro laipsnj 
ir domisi socialiniais klausimais. Daug meti} 
dirbo su valstybinio lygmens programomis, 
skirtomis sumazinti paskaiti} nelankancii} ir 
studijas metusii} studenti} skaiciij. Siuo metu 
dirba tyreju Midwesterno universitete. 

Nathanas yra patynys, puikios reputaci- 
jos destytojas, rengia populiarius seminarus 


promotion and tenure papers (Accreditation 
report, p. 16). 

According to the Assistant Provost, stu¬ 
dent ratings were also the preferred source by 
campus administrators: 

Most administrators prefer to use student rating 
scores rather than qualitative information about 
teaching because they like the convenience of the 
numbers. 

The administration of the departments 
seemed particularly concerned about student 
ratings when they were low in comparison 
with the ratings of other instructors at the col¬ 
lege or campus level. 

Some University Board members inter¬ 
viewed were concerned about the use of TES 
rating scores for making decisions about 
teaching and promotion. One member of the 
Board in particular, believed that with the em¬ 
phasis put by the university on the TES ratings, 
it could become an incentive for professors to 
pay more attention to make students happy 
rather than in making them reflective about 
their teaching. The trade-offs resulting from 
the decision of giving high emphasis to stu¬ 
dent ratings were given little attention by the 
institution. 

The Instructor. 

The case study was conducted around Nathan. 
He was an evaluator and educational policy 
analyst for seventeen years prior to his current 
position as a researcher in the area of transi¬ 
tion services for youth with disabilities. Most 
recently he has moved to an administrative po¬ 
sition. He had a Ph.D. in educational psychol¬ 
ogy. Having had an interest in social issues, he 
worked for many years in implementing tru¬ 
ancy and dropout prevention programs at the 
state level. After working for the State Board 
of Education for seventeen years, he became a 
researcher at Midwestern University. 

Nathan had prior experience as a teacher 
and a reputation as an excellent lecturer. He 
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jvairiose Jungtiniij Valstijij vietose. Desty- 
tojas stengesi, kad jo studentai tapti} gerais 
mokytojais, atsizvelgdavo j visus jij poreikius. 
{ kiekviencj. student^ ziurejo kaip j asmeny- 
by, palaike negalicj turinciuosius ir kritinj 
mokymcjsi. 

Pries 6 metus pradej^s dirbti Midwester- 
no universitete, Nathanas pasisiule destyti 
kursq specialiojo mokymo padalinyje. Kaip 
tyrimu bendradarbis, o dabar dar ir admi- 
nistracijos darbuotojas, jis neprivalo destyti, 
bet paprase sios galimybes, nes labai megsta 
mokyti kitus ir tiki, kad destydamas kitiems 
pats daug ismoks bei patobulins profesinius 
savo jgudzius: 

As pasisiuliau destyti sj kursq, nes megstu 
mokyti kitus, ypac jaunus, entuziastingus bu- 
simuosius mokytojus. Taip pat manau, kad 
mokydamas kitus daug suzinai ir pats. Nore- 
jau daugiau suzinoti apie specialiojo mokymo 
pagrindus ir jvairias negalios saknis. Taip pat 
norejau patobulinti ir destymo jgudzius. 

Sio tyrimo metu j Nathano destomq da- 
lykq buvo uzsiregistrav^ 255 studentai, is jij 
bene 95 % - moterys (daugiausia baltaodes), 
mazdaug 5 % - vyrai. Afroamerikiecq, lotynij 
amerikieciij ir azijieciij kilmes studentai su- 
dare mazdaug 10 %. Nathano destomo kurso 
klause ivairiij kursq studentai - nuo zemes- 
niqjq ir vyresniqjq kursq iki antrosios pako- 
pos. Destyti padejo keturi skirtingos kilmes 
asistentai - turintys labai gerus angle} kalbos 
jgudzius ir pazangus antrosios studiji} pako- 
pos studentai: du is Azijos (vienas - is Kini- 
jos, kitas - is Korejos), kiti du - is Indijos ir 
Meksikos. Nors kalbejo su akcentu, taciau tai 
nebuvo kliutis bendrauti. 

Nathanas leido studentams dirbti su asis- 
tentais, jo manymu, daugeliui tai bus viena is 
kelii} galimybii} pabendrauti su kiti} kulturi} 
atstovais. Kiekvien/} savait^ po paskaitos des- 
tytojas susitikdavo su asistentais, kad jvertin- 
tp studenti} darbus ir isitikinti}, jog pateiktos 
ataskaitos yra tikslios ir nuoseklios. Per susi- 
tikim;} taip pat budavo reflektuojama praejusi 


generally receives compliments as a speaker 
from the participants of the workshops that he 
conducts in various parts of the United States. 
Nathan was a good instructor partly because 
he had a genuine interest in helping his stu¬ 
dents to become good teachers and because he 
was sensitive to the needs of all his students. 
He treated each of them as a person and was 
an advocate for students with disabilities and 
critical learning. 

Six years ago when Nathan began to work 
for Midwestern University, he offered to teach 
a course in the department of special educa¬ 
tion. As a research associate and now an ad¬ 
ministrator, he is not required to teach, but he 
asked for this opportunity because he enjoys 
teaching and because he believes that teaching 
helps him to keep learning and improving his 
professional skills: 

I volunteered to teach this class because I enjoy 
teaching, especially young, bright, future teach¬ 
ers. I also think that when you teach you learn 
more. I wanted to learn the fundamentals about 
special education and the nature of various dis¬ 
abilities and I wanted to improve my teaching 
skills. 

During the time of the study, there were 
two hundred fifty five students registered for 
Nathans class, ninety five percent of these 
students were females (mostly, white females) 
and approximately five percent were males. 
Students of African, Hispanic or Asian descent 
were about 10% of the whole student body at¬ 
tending the class. Students were at different 
levels in their program of study, from juniors 
to seniors to graduate students. To assist Na¬ 
than with the class, there were four teaching as¬ 
sistants, all of them from diverse backgrounds. 
They were proficient in English and were at an 
advanced level in their graduate program. All 
of them had an accent but this was not an ob¬ 
stacle for communicating with others. Two of 
the assistants were Asian, one from China and 
the other from Korea. The other two assistants 
were from India and Mexico. 
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paskaita. Pats Nathanas kiekvienij savait^ 
daugiau nei 10 valandij skirdavo pasiruosti 
kitai paskaitai, rengdavo dalonujkj medziagq 
ir paskaitos uzrasq kopijas studentams, su 
asistentu pildydavo siam kursui skirt q tinkla- 
lapj. Papildomai ruose praktikos egzaminq, 
elektroniniais laiskais bendravo su studentais 
ir du kartus susitiko su jais ne paskaitij metu, 
kad pries galutinj egzamimj perzvelgtij desto- 
mo kurso turinj. 


Kurso destymas. 

1999 m. pavasario semestre Nathanas nau- 
dojo projektoriaus skaidres, pristate atskirus 
atvejus ir pasakojo istorijas, kad supazindintij 
studentus su svarbiausiais istoriniais ir teisi- 
niais specialiqjq poreikii} studentij mokymo 
aspektais, praturtintij zinias apie individua- 
liq mokymo program^ procesus ir skirtingas 
negalias. Parenge keletq komandiniij uzduo- 
ciq, kurias reikejo atlikti ribotoje auditorijos 
aplinkoje. | paskaitas pakviete porij sveciij: 
vienas kalbejo apie savo, kaip aklo studen- 
to, patirtj mokantis, antroji viesnia pasakojo 
apie mokyklos ir seimos rysius bei savo, kaip 
kurckj dukrij auginancios mamos, patirtj. 
Studentams patiko ir jie pasiule ateityje pa- 
kviesti daugiau svecip. Per paskaitas Natha¬ 
nas prasydavo studentij pateikti atsiliepimus, 
o isskirtinumo ir jvairoves aspektus aptarda- 
vo tyrimais grindziamu poziuriu. Destytojas 
atsizvelge j studentij poreikius ir dviem ne- 


Nathan gave students this opportunity to 
interact with the teaching assistants because he 
thought that for most of his students this was 
one of the few occasions in which they could in¬ 
teract with persons from another culture. Every 
week after class, Nathan met with all the teach¬ 
ing assistants to grade the papers and to be sure 
there was consistency and accuracy in the re¬ 
views. He also used the meeting as a reflection 
about the class. On his own, Nathan spent more 
than ten hours per week preparing for the class, 
creating class handouts and copies of his lecture 
notes for the students, and working with one of 
his assistants in the development of the course 
website. He also spent extra time planning a 
practice exam, communicating with students 
through e-mail, and meeting twice with them 
outside class to review the course contents prior 
to the final exam. 

Teaching the Course. 

During spring 1999, Nathan lectured most 
of the time using overhead transparencies, 
cases and stories to teach students about the 
historical and legal issues in the education of 
students with special needs and to increase 
their knowledge and understanding of the 
individualized educational program process 
and types of disabilities. He organized some 
teamwork activities within the limitations of 
the physical arrangement of the classroom. 
He also invited two guest speakers to the 
class, one of them to talk about his education¬ 
al experiences as blind student with disabili¬ 
ties. The other speaker talked about school 
and family relations and her experience as a 
mother of deaf girl. Students seemed to like 
the speakers and suggested Nathan to invite 
more guests in the future. During class ses¬ 
sions, Nathan constantly asked students for 
feedback and used an inquiry approach when 
discussing issues of exceptionality and diver¬ 
sity. He was also sensitive to the needs of all 



86 


AUKSTOJO MOKSLO KOKYBES TYRIMAI • RESEARCH ON QUALITY OF HIGHER EDUCATION • 2013/10 


galiq turintiems studentams suteike speciality 
patogutmj 1 . 

Nathanas tikejosi, kad studentai aktyviau 
naudosis Siam dalykui skirtu tinklalapiu, bet 
daugelis jame ieskodavo tik paskaitij medzia- 
gos, jei negaledavo dalyvauti. Vos viena ne- 
galiq turinti studente pasinaudojo pokalbiq 
programa, kad paklaustq, ar galima j praktinj 
testq atsinesti maisto, nes ji serganti cukriniu 
diabetu. Antrajame semestre studentai pasi- 
skunde, kad per ilgai trunka atsisiijsti infor- 
macijq, todel Nathanas perkele visq destomqjq 
medziagq. Naujoji svetaine buvo paprastesne, 
studentai greiciau rasdavo reikiamq medzia- 
gcj, bet prireike daugiau laiko jai kurti. 

Studentai bendravo su destytoju elek- 
troniniu pastu - paprastai klausdavo, kada 
reikia atlikti darba arba kam jj pristatyti. 
Elektroniniais laiskais susirasinedavo ir su 
asistentu, kuris tikrindavo jq atliktus darbus 
ir pateikdavo atsiliepimus apie uzduotis. Tik 
du studentai prase Nathano susitikti ne pas- 
kaitij metu ir jij noras buvo patenkintas. 


Nathano destomos paskaitos jvertinimas. 

Nathano darbui jvertinti parengta anketa ir 
isdalyta studentams likus dviem savaitems 
iki galutinio egzamino. Joje buvo pateikti du 
bendro pobudzio ir specialus klausimai, skirti 
Nathano destymui jvertinti. Bendro pobudzio 
klausimai naudoti apibendrinimo tikslais, o 
atskiri konkretus klausimai skirti dalyko stu- 
dijoms gerinti (padaliniij lyginimas). 


1 Vienas studentas turejo mokymosi sutrikimi}, todel jam 
reikejo papildomij konsultacijij po paskaitij ir galimybes 
egzamin^ laikyti vienam. Kitas studentas sirgo cukriniu dia¬ 
betu, todel j paskaitas turejo atsinesti maisto. 


his students and provided accommodations 
for two students with disabilities 1 . 

Contrary to Nathan expectations, stu¬ 
dents limited their use of the course website. 
Most of them relied on the materials that he 
provided to the class and only reviewed the 
website if they missed a session. Only one of 
the students with disabilities used the chat 
room to ask if she could bring some food to 
the practice test because she had diabetes. By 
the second session, student complaints about 
the time required for downloading informa¬ 
tion motivated Nathan to move the course 
from the university website to a new faster 
website. The new course site was less elaborate 
in the display of information and was easy to 
access; however, this decision to change web¬ 
sites resulted in more time needed to website 
development. 

What students really used to communi¬ 
cate with Nathan was electronic mail. Gener¬ 
ally, students asked questions about due dates, 
or about to whom they should turn in their 
papers. Students also used e-mail to commu¬ 
nicate with the teaching assistant who was as¬ 
signed to review their papers and provide them 
with feedback about their assignments. Only 
two students asked Nathan for an appoint¬ 
ment after class, a request that he granted. 

Evaluating Nathan'Class. 

Nathan teaching was evaluated using a ques¬ 
tionnaire administered two weeks before the 
final exam. The questionnaire included two 
global items and a set of specific items to eval¬ 
uate his instruction. The two global items were 
used for summative purposes and the set of 
specific items for instructional improvement 
(departmental comparison). 


1 One of these students was a student with learning dis- 
abilities who requested to take the exam alone and to receive 
advising after class. The other student was a diabetic student 
who requested to bring food during class sessions. 
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{vertinimo rezultatij duomenimis, Nat- 
hano reitingas buvo zemesnis nei vidutinis, 
palyginti su kitais to paties padalinio ir uni- 
versiteto destytojais. Is atvira forma pateiktij 
komentarij matyti, kad viena problermj - per 
daug medziagos, kuricj. reikia perskaityti, 
ypac IDEA dokumentij. Be to, septyni stu- 
dentai skundesi antrosios studijij pakopos 
asistentais. Trys kritikavo asistentij gebeji- 
mus bendrauti angle} kalba. Vienos studen- 
tes nuomone, absolventai asistentai nemok^ 
angle} kalbos, todel ji nenorinti, kad kuris is 
jij tikrintej jos darbus. Kai kurie studentai uz- 
simine jaut^si nejaukiai, pries galutinj egza- 
min;} vertindami profesoriaus darbt}. 

Destymo jvertinimo rezultatai taip pat 
rodo, kad studente} nuomone, is anksto pa- 
teikti kurso tikslai nepriestaravo tam, kas 
buvo destoma, o destytojas dirbo su entu- 
ziazmu, paskaitoms pasiruosdavo tinkamai. 
Taciau vertinant medziagos, kuri;} reikia per¬ 
skaityti, pasirinkim^, darbo kruvj ir per pas- 
kaitas aptartos medziagos atspindejim;} rasto 
darbais ir per egzaminus, studentej nuomo- 
nes issiskyre. 2 

Is sio jvertinimo Nathanas suzinojo, k^ 
apie jo destomc} kurs;j galvoja studentai, bet 
kilo ir tam tikrej probleme}. Pirma, reitingas 
skaiciuotas pagal jvertinimo vidurkj, taciau 
rezultatai neparodo studentej skirtume} bei 
neatspindi tautiniej mazumij studentej nuo- 
mones - pasirinkus vidurkj, ji paprasciausiai 
isnyko bendroje duomenej maseje. Antra, 
jvertinimas neatspindejo neigiamos studentej 
nuomones apie kurs^. Per pirm;j susitikim;} 
Nathanas klause, kodel jj pasirinko, ar nori 
cia buti, ar mano, kad paskaitos bus naudin- 
gas ateities veiklai. Tik 5 is 200 studentej atsa- 
ke norej§ uzsiregistruoti j sj kursej. Lik§ 255 
teige: jeigu butej turejij galimyb^ rinktis, ne- 
butej registrav^si. Mazdaug 40 studentej nu- 
rode nemanantys dirbti mokykloje, kuriej 
lankytej negalicj turintys ar tautiniej mazumej 


2 Studentai si^ nuomonf issake dar pries egzamiiu}. 


According to the evaluation results, Na¬ 
than obtained lower than average ratings when 
compared with other professors at the depart¬ 
ment and at the campus level. Students open- 
ended comment about the course suggested 
that one of the problems with the course was 
the amount of reading, especially the IDEA 
documents. In addition, Seven students com¬ 
plained about the graduate assistants. Three of 
these students made specific comments criti¬ 
cizing the teacher assistants ability to com¬ 
municate in English. One of these students 
mentioned that in her opinion the graduate 
assistants did not know English, and that she 
did not like to have any of them reviewing her 
papers. Some students also mentioned that 
they felt uncomfortable making a judgment of 
grading procedures before the final exam. 

Results of the evaluation also showed that 
students perceived that there was consistency 
between the announced course objectives and 
what was taught and that Nathan was enthu¬ 
siastic about teaching. Students also perceived 
that Nathan seemed well prepared for classes. 
Less agreement existed among them in their 
perceptions about the appropriateness in the 
selection of class readings, the amount of 
course workload, and the papers and exams 
reflected in the material covered. 2 

Although the evaluation provided Na¬ 
than with important information about how 
students felt about his class, the evaluation 
presented some problems. First, the use of an 
average to calculate his rating score hide the 
differences among the students and did not 
reflected the perception of the minority stu¬ 
dents in the class. By selecting an average, the 
opinions of these students disappeared in the 
mass of data about the evaluation. Secondly, 
the evaluation failed to represent the negative 
attitude of students about the course. During 
the first session, Nathan asked students why 
they were taking the class, if they wanted to be 

2 Students made this judgement before the exam was 
administered. 
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mokiniai. Tokio neigiamo poziurio j destomq 
dalykcj. jvertinimas, atliktas pries prasidedant 
paskaitoms, neatspindejo - tada tik 13 stu- 
dentp nuomone buvo neigiama. 

Trecia, Nathano destomo dalyko verti- 
nimas standartizuotu metodu, kurj nusta- 
te padalinys ir universitetas, neatspindejo 
neigiamos studentij nuomones ir jij nenoro 
bendrauti su destytojo asistentais. Is tiesp 6 is 
7 studentij, ivertintij negiamai, galejo surink- 
ti pakankamai taskij, kad jvertinimas butij 
teigiamas, jeigu butij susitikij su destytojo 
asistentais ir pataisij pirmqjj darbq. Bet jie to 
nepadare. Viena baltaode studente, jvertini- 
mo anketoje labai kritikavusi destytojo del 
asistentij anglij kalbos ziniij, taip pat priesin- 
gai buvo nusiteikusi ir asistento lotynij ame- 
rikiecio atzvilgiu. Jai buvo paskirta kita des¬ 
tytojo asistente, vertinusi rasto darbus, taciau 
studentei du kartus nejtiko ir asistente lotynij 
amerikiete. Pirmcj kartq studente sukritikavo 
destytojo asistentes darb;j ir pareiske, kad ji 
ir kiti asistentai bei pats profesorius turetij 
prisiimti atsakomyb^ uz kylancias problemas. 
Antnj kartq studente nesusivalde pildydama 
destymo jvertinimo anketq: uzuot padavusi 
uzpildyUj anketij renkanciam studentui, mete 
jcj asistentei lotynij amerikietei sakydama: 
„Jus visi uzknisate". Destytojo asistentai kartu 
su Nathanu aptare studentes elgesj, bet nesu- 
prato, kodel ji taip elgiasi. Kine magistrante 
Mei-Yeh, atsakinga uz rasto darbij ivertinimij, 
pastebejo, kad siai studentei kildavo sunku- 
mp rasant straipsniij recenzijas: ji parasydavo 
puikias straipsniij santraukas, bet nesugebe- 
davo jp kritiskai analizuoti. Mei-Yeh pateike 
studentei siiilynuj, kaip patobulinti rasto dar¬ 
bus, bet ji nepaise rekomendacijij ir neteko 
ivertininuj sudaranciij taskij. Mei-Yeh nega- 
lejo suprasti, kodel studente jai nieko nesake, 
o visp nepasitenkinimcj isliejo kitam destyto¬ 
jo asistentui. 

Lotynij amerikiete destytojo asistente Ju¬ 
lia nebuvo jsitikinusi, ar problemij kyla del 
jos rases, bet labai sunerimo: 


there, and if they thought the course was going 
to be useful for their future practice. Only five 
of two hundred students indicated that they 
wanted to take the class, the other two hundred 
fifty indicated that if they were given a choice, 
they would have never registered for the class. 
Around forty students indicated that they did 
not expect to teach in a school where students 
with disabilities or minority students would at¬ 
tend. This negative attitude toward the course 
was not reflected in the evaluation results when 
only thirteen of these students expressed a neg¬ 
ative opinion before taking the class. 

Third, the evaluation of Nathan’ class, us¬ 
ing the standardized procedure set by the 
department and the campus, did not reflect 
the negative attitudes and their reluctance to 
interact with the teaching assistants. Indeed, 
six of the seven students who failed the course, 
could have obtained enough points to pass the 
course if they had met with the teaching as¬ 
sistants and made the corrections on their first 
paper, but they decided not to do this. A white 
female student, who strongly criticized the 
instructor in the evaluation questionnaire for 
having teaching assistants who lacked English 
proficiency, also demonstrated an aggressive 
attitude towards the Hispanic TA 3 . Although 
she was assigned to meet with another teach¬ 
ing assistant who graded her papers, this stu¬ 
dent demonstrated an aggressive attitude to¬ 
ward the Hispanic TA on two occasions. The 
first time, she approached her to criticize the 
class and told her that she should be held ac¬ 
countable for any problems, as well as the other 
assistants and the instructor. The second time, 
she lost her temper after completing the evalu¬ 
ation of the course and instead of giving the 
form to the student who was collecting them, 
she threw the evaluation form at the Hispanic 
TA while saying “you all suck”. The teaching as¬ 
sistants discussed the behavior of this student 
among themselves and with Nathan and were 


3 Teaching assistant 
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Nezinau, ar tokj elgesj skatina rasiniai skirtu- 
mai, taciau labai nerimauju, kai kazkas taip 
susierzina ir netinkamai elgiasi. Man labai ne- 
ramu, kadjei sijauna moteris dirbs klaseje ir 
jai pasitaikys bloga diena, jos mokiniai kentes 
del tokio mokytojos susierzinimo. 

Nathano nuomone, sic), problem^ sukele 
rasiniai skirtumai, nes destytojq ir jo asisten- 
tus studentai suvokia kaip auditorijos auto- 
ritetus. Studentes poelgis aiskintinas taip: ji 
jautesi galinti taip elgtis su Julia, bet ne su ki- 
tais, nors Julia nebuvo atsakinga uz jos rasto 
darbi) tikrinimc), ir kazkodel savo pyktj ir su- 
sier/.inimc) isliejo asistentei, o ne pasikalbejo 
su destytoju ar blogus pazymius jai parasiu- 
siu asmeniu. 

Destytojo asistente inde Suparna taip pat 
pastebejo, kad studentai ignoravo jos patari- 
mus, kaip patobulinti rasto darbus. Asistentes 
manymu, neigiamc) studentij nuomon^ apie 
destomcj kursc) galejo paskatinti isankstiniai 
lukesciai. „Manau, kad kai kurie studentai 
uzsiregistruoja j sj kursq tik todel, kad jis 
trunka astuonias savaites ir yra privalomas. 
Jie nesupranta, kad Siam kursui keliami tokie 
pat reikalavimai, kaip ir bet kuriam kitam 
pirmosios studijij pakopas kursui“. Suparnos 
nuomonei apie studentp motyvacijc) pritare ir 
asistente Kim. 

Ne visi studentai apie destytojo asisten- 
tus atsiliepe neigiamai. Kai kurie recenzijose 
rase labai vertinantys suteiktc) galimybq dau- 
giau paskaityti ir suzinoti apie mokinius su 
negalia ir pripazino, kad itin daug tautinil) 
mazumij mokinii) buvo netinkamai perkelti 
j specialiijjq poreikii) turinciqjq klases. Prak- 
tikq atliekantys studentai atviriau issake po- 
zityvesn^ nuomon^ apie pateiktus straipsnius 
ir destomc) kursc). Pavyzdziui, Julia gavo tris 
padekos rastelius uz savo kaip destytojo asis¬ 
tentes darbcj. Du is ji) parase baltaodes stu¬ 
dentes, ir vienc) - lotyni) amerikiete. Visos jos 
tuo metu atliko mokytojos praktikc). Viena 
baltaode studente rase: 


unable to understand why she behaved in this 
way. Mei-Yeh, the Chinese student responsible 
for grading her papers, mentioned that this 
student was having problems writing her ar¬ 
ticle critiques. She was very good at summa¬ 
rizing the articles but failed to criticize them. 
Although Mei-Yeh had written suggestions for 
the student to improve her papers, she contin¬ 
ued ignoring the recommendations and con¬ 
sequently lost grading points. What Mei-Yeh 
did not understand is why the student did not 
say anything to her and reacted in a negative 
way toward the other teaching assistant. 

Julia, the Hispanic teaching assistant, was 
not sure if this was a racial issue, but she was 
very concerned about the student attitude: 

I don’t know if this behavior is racially motivated 
or not, but I am concerned about someone who 
becomes frustrated and behaves in this way. I 
will be especially concerned if this young woman 
gets into a classroom and when she has a bad 
day her students have to pay for her frustration. 

Nathan, on the other hand, believed that 
this was a racial issue. He believed that the 
class perceived the teaching assistants and the 
instructor as being authority figures in the 
classroom. If that student selected Julia for tar¬ 
geting her aggression, it was because somehow 
she thought she could treat her in that way, but 
not treat the others similarly. Even though Ju¬ 
lia was not the teaching assistant responsible 
for reviewing her papers, the student chose her 
to display her anger and frustration instead of 
talking to the person who was giving her low 
grades or to the instructor. 

Suparna, the Indian teaching assistant in 
the class, also perceived that students were 
ignoring her suggestions for improving their 
papers. She also thought that a possible rea¬ 
son for students negative attitudes towards the 
course were their prior expectations. She men¬ 
tioned: “I think some students register for this 
class because it is only an eight week course 
and it is required. They may think it is going to 
be easier than other courses they have taken. 
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Aciu jums uz kantrybq ir uz viskq. Sunku net 
jsivaizduoti, kiek daug turejote dirbti, kol pa- 
tikrinote tiek daug darbq ir sprendete musq 
klausimus. Siose paskaitose supratau, kaip 
sunku mokyti kitq ir kokie auksti reikalavimai 
keliami mokytojui. Labai jums aciu ir geros 
vasaros. 

Studentq pateiktuose jvertinimuose at- 
sispindi neigiamas poziuris j destomq kursq, 
o kai kuriais atvejais - j destytojo asistentus. 
jvertinimo rezultatai gali buti klaidinantys ir 
sudaryti jspudj, kad Nathano destymas pras- 
teja arba kad technologijq naudojimas neigia- 
mai paveike reitingus. Firmcj kartcj Nathano 
destymo reitingas buvo 3,9 / 5,0, kitais me- 
tais surinko 4,0 / 5,0, o 1999 m. pavasarj - tik 
3,5 / 5,0. Neatkreiptas demesys, kad studentq 
skaicius Nathano dalyke ir pacios grapes su- 
detis visus trejus metus keitesi: 1997 m. buvo 
75 studentai, is kuriij 62 uzpilde jvertinimo 
formas; 1998 m. - 98 (is jq 80 uzpilde jverti¬ 
nimo formas), o 1999 m. - jau 255, is kuriij 
jvertinimo formas uzpilde tik 130. 

Skyresi ne tik grapes dydis ir jvertinimo 
formas uzpildziusiq studentij skaicius, bet 
ir sqlygos auditorijose, kuriose vyko Natha¬ 
no paskaitos, bei studenti} charakteristikos. 
1998 m., kai destymas buvo jvertintas auks- 
tesniais balais, paskaitos vyko mazesneje 
auditorijoje, kurioje buvo galima labiau ben- 
drauti su studentais. 1999 m. paskaitos vyko 
dideleje auditorijoje, kurios garso akustika ne 
itin gera. Del sip priezasciq nukentejo desty¬ 
tojo bendravimas su studentais. 

Be to, dalykq lanke skirtingi studen¬ 
tai. Antrosios pakopos studentq skaicius 
skyresi visus trejus metus. Jie lanke kaip 
pasirenkamqjj dalykq, tad jq turimp zinip 
lygis ir ankstesne patirtis dirbti su ne- 
galip turinciais asmenimis buvo kitokia. 
Studentai, atliekantys mokytojo praktik^ 
ir jau susidur^ su negali^ turinciais mo- 
kiniais, pateike pozityvesnius dalyko ir 
destytojo jvertinimus. Viena studente net 
rase dienorastj, kaip jgytos zinios atliepe 


What they don’t realize is that this course has 
the same demands that any other undergradu¬ 
ate course.” Kim, the other teaching assistant 
shared Suparna’s perception about students’ 
motivation towards the course. 

The negative student attitudes towards the 
teaching assistants were not the case for all stu¬ 
dents. There were students who expressed in 
their critiques that they really appreciated the 
opportunity to read and learn about students 
with disabilities and acknowledged that they 
did not realize the significant number of minor¬ 
ity students who were inappropriately placed 
in classrooms for special needs students. Stu¬ 
dents who were in their classroom practicums 
were also more open and more positive in their 
comments about the articles and their percep¬ 
tions about the course. For example, Julia re¬ 
ceived three thank you notes for her work as a 
teaching assistant. Two of the notes were from 
white female students and the other was from a 
Hispanic female student, all of whom were stu¬ 
dent teachers while they took the course. One 
of the white female students wrote: 

Thank you for your patience and for everything. 
I can not imagine how hard it would have been 
reviewing so many papers and dealing with all 
of our requests. This class has helped me realize 
how hard it is to teach and how great the teach¬ 
ing demands on the instructor are. Thank you 
so much and have a great summer. 

In addition to students’ negative attitudes 
towards the course and in some cases towards 
the teaching assistants, the evaluation results 
could be misleading and give the impression 
that Nathan is getting worse at teaching or that 
using technology can negatively impact your 
ratings. When he first taught the course he ob¬ 
tained a rating of 3.9/5.0 for his teaching. The 
following year, he obtained 4.0/5.0. But, dur¬ 
ing spring 1999, Nathan ratings were 3.5/5.0. 
What is not considered is that Nathan class 
size and class composition varied in those 
three years. During 1997, Nathan had only 75 
students in the course, 62 of which completed 
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jos patirtj dirbant su mokymosi sutrikimq 
turinciu mokiniu. 

Be to, j standartizuoto jvertinimo apklau- 
sy nebuvo galima jtraukti keliq svarbiq aspek- 
ti} apie Nathano destymy. Reiketq pamineti 
jo naudojamy tiriamyjj poziurj, nory suteikti 
studentams galimyby jgyti naujij ziniq ir mo- 
kejimij, pastangas keisti studenty supratimy 
apie tautinip mazumq ir negaliy turincius 
mokinius, suteikus galimyby pabendrauti su 
kitokiais zmonemis. 

Jvertinimas neatspindejo, kiek laiko pri- 
reike kurti tinklalapj, skirt y specialiai des- 
tomam dalykui, arba kad technology a pati 
savaime negerina destymo. Technology os - 
tik priemones, kuriy naudingumas priklau- 
so nuo studenty gebejimo ir polinkio jomis 
naudotis. 

Be to, j kai kuriuos jvertinimo apklausos 
klausimus negalima tinkamai atsakyti. Pa- 
vyzdziui, du toliau pateikti klausimai aprepia 
aspektus, kuriy studentai negali tinkamai 
jvertinti, nes jiems truksta ziniy apie desto- 
mo dalyko turinj, apie konkreciai temai priei- 
namy skaitymo medziagy ir jy tinkamumy 
studijoms. 

• Ar skaitymui parinkta tinkama medziaga? 

• Destytojas yra gerai pasiruosqs paskaitoms. 

Studenty galimybes suzinoti, kiek laiko 
destytojas praleido ruosdamasis paskaitoms 
ir ar tinkamai joms pasiruose, yra ribotos. Ir 
uz tai atsakingi yra ne studentai, o fakulte- 
to darbuotojai. Studentai menkai nusimano, 
kaip dalyko turinys pletojamas, tad negali 
tinkamai jvertinti destytojo pasirengimo. 
Braskampo ir Ory (1994) teigimu, studentai 
gali tinkamai jvertinti destymy ir aprasyti 
ar vertinti destytojo-studento bendravi- 
my, poziurj j destytojo elgesj ir darbo kru- 
vj. Galima klausti, ko studentai ismoko, ar 
destytojo vertinimo sistema buvo syzininga, 
ar jis sugeba aiskiai bendrauti. Taciau jie ne¬ 
gali tinkamai jvertinti aspekty, tiesiogiai ar 
netiesiogiai susijusiy su „dalyke destomos 


the evaluation forms. In 1998, the number of 
students increased to 98 with 80 students com¬ 
pleting the evaluation forms, but in 1999, he 
had 255 students. Of these 255 students, only 
130 completed the evaluation forms. 

In addition to class size and the number 
of students evaluating the course, the condi¬ 
tions of the classrooms where Nathan taught 
the class and the characteristics of his students 
were different. In 1998, when he obtained high¬ 
er ratings for his teaching, he was teaching in 
a smaller classroom that allowed for more stu¬ 
dent interaction. In 1999, he began to teach in 
the big auditorium with inadequate acoustics, 
both of which limited student interaction. 

Moreover, students who registered for the 
course were different. The number of gradu¬ 
ate students choosing to take the course as an 
elective varied during the three years and they 
had various levels of background knowledge 
and prior experiences with students with dis¬ 
abilities. The students who were conducting 
their teaching practices and had interacted 
with students with disabilities were more posi¬ 
tive about the course and the instructor. One 
of these students even kept a diary where she 
wrote about how the knowledge acquired 
in the course was related to her experiences 
working with a student with learning disabili¬ 
ties in her classroom. 

Furthermore, the standardized evalua¬ 
tion survey was unable to capture important 
aspects of Nathan teaching. For example, his 
inquiry approach and his concern for provid¬ 
ing students with the opportunity to acquire 
knowledge and skills, and the way he chal¬ 
lenged their perceptions about minority stu¬ 
dents and students with disabilities by giving 
them the opportunity to interact with some¬ 
one different to themselves. 

The evaluation also failed to recognize 
the enormous time commitment needed to 
develop the course website and the fact that, 
per se, technology can not improve teaching. 
Technology is a tool and its useful benefits 
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medziagos kokybe arba destytojo ziniomis 
ir erudicija" (Braskamp ir Ory, 1994, p. 99). 


Atvejo tyrimo santrauka. 

Nathanas - kvalifikuotas destytojas, galintis 
destyti sj kursq ne tik del profesiniij ziniq 
ir pedagoginiij jgudziq. Jis turi sukaupqs 
daug ziniq apie kulturinius skirtumus ir is- 
skirtinius dalykus, yra jautrus ir gali daryti 


depend on students’ ability and disposition 
for using it. 

In addition, some of the items included in 
the evaluation survey may not be appropriate 
for students to respond to. For example, the fol¬ 
lowing two items on the evaluation form used 
for departmental comparison focus on aspects 
that students can not properly evaluate be¬ 
cause they have little knowledge about course 
content, the available readings in the subject 
matter, and their pedagogical appropriateness. 

• Where readings well selected? 

• The instructor seem well prepared for 
classes. 

Students are in a limited position to know 
how much time the instructor invested in pre¬ 
paring for the course and if he was well pre¬ 
pared. These items require students to make 
an inference in areas that refer to faculty ex¬ 
pertise, when they lack an understanding of 
the ongoing evolution of the discipline, which 
is necessary to make a judgment about the re¬ 
quired preparation for a class. As Braskamp & 
Ory (1994) assert, students are good sources 
for evaluating teaching and can provide an 
important perspective to describe or judge 
the student-instructor relationship, the stu¬ 
dents’ views of the instructor’s behavior and 
their workload. They are an appropriate source 
when asking about what they have learned in 
the course, the fairness of grading, and instruc¬ 
tor’s ability to communicate clearly. Student ap¬ 
praisal, however, is not appropriate when the 
evaluation requires them to make a judgment 
of aspects that directly or indirectly judge “the 
quality of the course content or the knowledge 
and scholarship of the instructor” (p. 99). 

Case Study Summary. 

Nathan is a qualified instructor to teach this 
course, not only because of his knowledge of 
the content or his pedagogical skills, but also 
because of his sensitivity and knowledge about 
cultural differences and exceptionalities and 
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atitinkamas isvadas. Paskaitij medziaga, des- 
tymo strategy os ir bendravimas su studentais 
bei asistentais atspindejo destytojo nory per- 
duoti busimiems mokytojams butinas zinias, 
mokejimus ir poziurj, leidziancius tinkamai 
reaguoti j jvairiy besimokanciyjy poreikius. 

Taciau kursas buvo prastai jvertintas del 
neigiamo studenti} poziurio ir nenoro ben- 
drauti su asistentais is tautiniij mazumy gru- 
piy bei kitij veiksniij. Reikejo daugiau laiko 
kursui parengti ir jvertinti; technology^ pa- 
naudojimas jame taip pat uzeme daug laiko, 
taciau tai, deja, nepateisino lauktij rezultaty. 

Stebint Nathano darby auditorijoje, is 
interviu su asistentais ir analitines standarti- 
zuotos studenti} i vert ini mu apzvalgos pavyko 
susidaryti ben dry paskaitos vaizdy - remian- 
tis tik destymo reitingais tai padaryti buty 
nejmanoma. Norint suprasti, kas vyksta au¬ 
ditorijoje, ir jvertinti destymo kokyb^, butina 
tureti informacijos apie bendry konteksty. 

Problemos, iskilusios tiriant Nathano 
atvejj, gali buti neaktualios kitiems destyto- 
jams. Taciau sios jzvalgos naudingos skai- 
tytojams, nes atkreipia demesj j issukius, su 
kuriais gaiety susidurti busimieji mokyto- 
jai, destydami kursus apie mokiniy ivairovy. 
Deja, neretai jie isreiskia neigiamy nuomon^ 
apie kursus, panasius j ty, kurj desto Natha- 
nas. Vienas profesorius, dirbantis kitame, bet 
baigys Midwesterno universitety, teigia: 
Destydamas tokius kursus daznai nusiviliu, 
nes studentams truksta motyvacijos. Regis, jie 
nesupranta, kad sie kursai gali buti jiems nau- 
dingi ateityje. 

Kita destytoja pastebejo, kad pirmosios 
pakopos studentai yra panasios nuomones ir 
apie jos destomy kursy. 

Destyti busimiems mokytojams apie moki- 
niij. jvairovg ir isskirtinumq yra tikras issukis 
destytojui. Paskutinis semestras mane tikrai 
nuvyle. Mano studentai net nedalyvavo pas- 
kaitoje. Nesvarbu, kiek pastangq dedavau, jie 
buvo labai pasyvus. Siame semestre mano 
kursq lanko daugiau antrosios studijq pakopos 


subsequent instructional implications. His 
interest in providing teachers with essential 
knowledge, skills and attitudes that make them 
responsive to the needs of diverse students was 
exhibited in the selection of the class materi¬ 
als, teaching strategies and his interaction with 
students and teaching assistants. 

Unfortunately, some students’ negative 
predisposition towards the course, reluctance 
to interact with minority teaching assistants, 
among other factors, resulted in low evaluation 
of his course and increased the amount of time 
needed in course preparation and grading. The 
use of technology in his course for the first time 
also required extra-work that did not seem to 
produce the expected impact on students. 

The observations of Nathan classroom 
instruction, interviews with his teaching assis¬ 
tants and the analytical review of the standard¬ 
ized student evaluations provide a broad pic¬ 
ture of Nathan’ class. This picture can not be 
obtained by looking at only the ratings of his 
teaching. Contextual information is vital for 
understanding what goes on in the class and 
for determining the quality of his teaching. 

Although the issues found by Nathan may 
not be applicable to other instructors, some 
readers may find them useful as they reflect on 
their challenges when teaching future teachers 
about diversity in the classroom. The nega¬ 
tive attitude of future teachers taking other 
courses similar to the course Nathan teaches, 
is unfortunately common. One professor from 
another university, who also graduated from 
the Midwestern University, expressed, 

One of the frustrations of teaching courses like 
this is the lack of motivation of students. It is 
like they don’t realize the importance of these 
courses for their future practice. 

Another instructor from the Southwest 
also found similar attitudes of undergraduate 
students toward her course. 

Teaching future instructors about exceptional 
and diverse students is a challenge for the in¬ 
structor. Last semester was discouraging. My 
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studentq, todel jie jsitraukia labiau. Gerai, kai 
grupeje yra studentq, kurie patys pasirinko sj 
dalykq. 

Nathano kolega, dalyvav^s rengiant busi- 
muosius mokyklq administratorius, taip pat 
tiki, kad su issukiais, kuriuos patyre Natha- 
nas, susiduria ir kiti destytojai, rengiantys 
studentus tapti mokykkj administratoriais. 
Jis pacitavo ir vieno studento komentarq apie 
aptariamq zmoniq jvairov^: 

Meksikieciai, meksikieciai, meksikieciai, 
Juodaodziai, juodaodziai, juodaodziai, 

Indai, indai, indai. 

Kada kalbesime apie kq nors kitq? 

Du administracijos darbuotojai ne is 
Nathano koledzo pareiske susirupinimq, kai 
reikiamam dalykui destyti samdomas kitos 
kilmes destytojas. Vienas jq pateike ir kon- 
kretcj pavyzdj. 

Pries kelis menesius is Azijos pakvieteme pro- 
fesoriq destyti kursq apie Azijos istorijq. ]am 
atvykus labai sunerimome, nes jis kalbejo su 
ryskiu akcentu, kurj buvo sunku suprasti. Be 
to, jis turejo mazai patirties naudoti aktyvaus 
studijavimo metodus. Todel kartu sujuo dirbti 
paskyreme ir asistentq - JAV indenq. Semestro 
pabaigoje buvo jdomu ir net netiketa suzino- 
ti, kad studentai labai gerai jvertino is Azijos 
atvykusj profesoriq. JAV indeno mokslininko 
reitingai buvo zemesni, nors jis turejo daugiau 
destymo patirties ir kalbejo aiskiau. 

Kitas administracijos darbuotojas dalijo- 
si panasia patirtimi: 

Kartais studentai skundziasi destytoju ir mes 
zinome, kad taip yra del jo rases ar etnines 
grupes. Pavyzdziui, pries porq metq musq pa- 
dalinys pasamde afroamerikiet\ destytojq des¬ 
tyti kursq apie afroamerikieciq istorijq. Nuste- 
bau, kai grupe baltaodziq studentq paprase 
jj pakeisti baltaodziu destytoju. Jie teige, kad 
afroamerikietis destytojas yra saliskas, todel 
neturetq destyti sio kurso. 

Nathano atvejis atskleidzia keblumus, ky- 
lancius rengiant busimus mokytojus ir verti- 
nant destymo kokyb^ bei stud ij 14 technologiji} 


students did not even participate in class. No 
matter how much effort I put in the class, they 
were just passive. This semester I have more 
graduate students in the classroom and my class 
is participating more. It helps to have students 
who elect to be in the class. 

A colleague of Nathan, who is involved in 
the preparation of future school administra¬ 
tors, also believes that the challenges faced by 
Nathan are also present for other instructors 
involved in preparing students to become fu¬ 
ture school administrators. He also quoted a 
comment made by one of his students about 
his course coverage of diverse issues: 

Mexicans, Mexicans, Mexicans, 

Blacks, Blacks, Blacks, 

Indians, Indians, Indians. 

When are we going to talk about something else? 

Two administrators outside of Nathan’ 
college also shared similar concerns when hir¬ 
ing an instructor with a diverse background to 
teach a required course. One of these adminis¬ 
trators illustrated these concerns. 

A few months ago we invited a professor from 
Asia to teach a course on Asian history. We 
were worried after his arrival because his accent 
was very thick and it was hard to understand 
him. Also, he was not proficient in active learn¬ 
ing methods. So, we placed a Native American 
scholar in his class to work with him. After lec¬ 
turing throughout the semester, it was surprising 
to find that the students give the Asian professor 
very high ratings. The Native American scholar 
obtained lower ratings than the instructor did, 
even though he was a better speaker and had 
more teaching experience. 

The other administrator also experienced 
a similar situation: 

Sometimes students complain about an ins¬ 
tructor and we know this is because of his race 
or ethnicity. For example, two years ago our 
department hired an African American Scho¬ 
lar to teach a course on African American his¬ 
tory. I was surprised when we had a group of 
White students asking for a White instructor to 
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naudojimy. Atliekant bet kokj vertinimy, bu- 
tina atkreipti demesj j siuos kintamuosius: 
grapes dydis, fizine auditorijos aplinka, stu- 
dentij poziuris j mokymysi, riboti gebejimai 
naudotis studijq technologyomis ir bendras 
studenty poziuris j ivairov^. 

Sis atvejis taip pat atskleidzia, kad uni- 
versitetai, kuriuose naudojama tik standar- 
tizuota jvertinimo sistema, nepaiso studenty 
studijavimo ir destymo kokybes kompleksis- 
kumo, nors destymo ir studijavimo tyrimai jj 
parodo. Vertinant destymy, reikia atsizvelgti 
j issukius, su kuriais susiduria destytojai: stu¬ 
denty kilm^, kulturinius tiek destytojy, tiek 
studenty skirtumus. 

Mokytojy rengimo programose studen¬ 
ty poziuris sudaro svarbiy destymo kokybes 
jvertinimo dalj, nes jy nuomone daro jtaky 
destytojo elgsenai auditorijoje. Tai sudetingi 
dalykai, kuriuos universitetai turety laikyti 
pagrindiniais destytojy jvertinimo ir tobule- 
jimo issukiais XXI a. 


ISVADOS 

Siame straipsnyje pristatytas destytojo Nat- 
hano G., skaitancio jvadinj specialiojo moky- 
mo kursy busimiesiems mokytojams, atvejis. 
Jis atskleide issukius, su kuriais susiduria tam 
tikry kursy destantys destytojai, ir padejo 
nustatyti jvertinimo sistemos trukumus ver¬ 
tinant destymo kokyby Taip pat bandyta 
aptarti technologijy naudojimo auditorijose 
privalumus ir trukumus. 


replace this professor. They argued that the Af¬ 
rican American instructor was biased and that 
he should not teach the course. 

Nathan case illustrates important issues 
in teacher preparation and in the evaluation 
of teaching and use of educational technology. 
Variables such as class size, physical classroom 
environment, student disposition toward 
learning, limited skills in using instructional 
technology, and students’ general attitude to¬ 
wards diversity deserve special attention in 
any evaluation effort. 

The case also presents evidence that, al¬ 
though the research on teaching and learning 
shows the complexities of student learning 
and teaching quality, universities using only a 
standardized evaluation system for evaluating 
teaching disregard or ignores this complexity. 
For any evaluation of teaching on campus, it 
is important to consider the challenges faced 
by instructors while addressing the needs of 
diverse students and to be sensitive to cultural 
differences of both instructors and students. 

Student’s attitudes in teacher preparation 
programs are an important part of any teach¬ 
ing and evaluation effort because attitudes in¬ 
fluence behavior in the classroom. These are 
complex issues, but universities need to ad¬ 
dress them as main challenges to teacher eval¬ 
uation and development for the 21 st century. 

CONCLUSIONS 

This paper develops around Nathan G., an in¬ 
structor teaching an introductory course in 
Special Education for future teachers. Nathan’ 
case was instrumental in studying the chal¬ 
lenges that the instructors teaching required 
courses face, and the limitations of the evalu¬ 
ation system in representing the quality of 
teaching. In addition, the case attempted to il¬ 
lustrate the benefits and obstacles when using 
technology in the classroom. 
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Gauti tyrimo rezultatai leidzia daryti svar- 
bias isvadas apie destymo, naudojant tech- 
nologijos, j vert i ninny Studijq technologijas 
naudojantys destytojai turetij pagalvoti, kad 
interneto konferencijq, elektroninio pasto ir 
kitij multimedijos priemoniij poreikis didzia 
dalimi priklauso nuo studentij studijavimo 
prioritetij ir motyvacijos, ar jie yra susipazin^ 
su naudojamomis elektroninemis priemone- 
mis ir geba jomis naudotis. Sit} technologijij 
nauda yra ilgalaike, todel naujiems destyto- 
jams deretij gerokai prie ip padirbeti. 

Tyrimas turi jtakos ir studentq, dalyvau- 
janciij mokytojij rengimo programose, verti- 
nimui bei rengimui. Svarbu, kad jie igytij zi- 
niij, mokejimij ir poziurq, reikalingu darbui 
daugiakultureje aplinkoje. Taciau vertinant 
daugiausia demesio skiriama ziniij ir moke- 
jimp jgyjimui, pamirsus viemj svarbiausiij 
mokytoji} rengimo aspektq - poziurj j skir- 
tingos kilmes mokinius. Mokytojij rengimas 
ir vertinimas turetij jtraukti ir jij poziurio 
ugdymo komponentq, nes, B. J. Grottkau ir 
S. Nickolai-Mays (1998) teigimu, busimieji 
mokytojai, dar nemokantys dirbti daugiakul¬ 
tureje mokymo aplinkoje, turi mazai lukesciij, 
susijusiij su tautiniij mazumij ir specialiijjij 
poreikiij mokiniais. Be to, skirtingij kulturij 
mokiniai mokosi skirtingais budais (Obiakor, 
Utley, 1997), todel mokytojai, nesusipazin^ su 
kulturine jvairove ar nekreipiantys demesio j 
siuos skirtumus, bus labiau link^ klaidingai 
juos traktuoti, vertinti, kategorizuoti ir mo- 
kyti. Jeigu busimieji mokytojai neatsizvelgs j 
visij savo mokiniij poreikius, tarp mokytojo ir 
mokiniij kils nesusipratinuj, galinciij neigia- 
mai paveikti mokymysi (Long ir kt., 1999). 

Tyrimas isryskino ir svarbius klausimus, 
susijusius su destymo koledzuose jverti- 
nimu. L. A. Braskampas ir J. C. Ory (1994), 
J. A. Centra (1993), H. W. Marsh (1984, 1982, 
1980), H. W. Marshas ir M. Dunkinas (1992), 
R. J. Menges ir K. T. Brinko (1986) bei kiti 
autoriai pateike rekomendacijas ir aprase ap- 
ribojimus, su kuriais susiduriama naudojant 


Findings of the study have important im¬ 
plications in the evaluation of teaching with 
technology. For instructors using educational 
technology in the classroom, it is important to 
consider that the benefits of web-conferencing, 
electronic mail and other multimedia depends 
in large part on students learning preferences, 
their familiarity and skills in using electronic 
means and their motivations. These benefits 
are also long-term benefits and impose a signif¬ 
icant amount of work for novice instructors. 

In addition, the study has strong implica¬ 
tions for the assessment and preparation of 
students participating in teacher preparation 
programs. For these students is important to 
acquire the knowledge, skills and attitudes 
required to successfully work in multicul¬ 
tural environments. The assessment, however, 
usually focuses only on student acquisition of 
knowledge and skills leaving unattended one 
of the most important aspects of teacher prepa¬ 
ration, their attitudes towards diverse students. 
The assessment and preparation of pre-service 
teachers must include an attitudinal compo¬ 
nent because as Grottkau & Nickolai-Mays 
(1998) mention, pre-service teachers who are 
untrained in multicultural education have low 
expectations for minority and special needs 
students. Further, because most multicultural 
students learn in different ways, (Obiakor and 
Utley, 1997) teachers who are not trained in 
multicultural matters or are insensitive to 
these matters are more likely to misindentify, 
misassess, miscategorize or misinstruct these 
children. If future teachers are insensitive to 
the needs of all students, misunderstandings 
between teacher and students can take place 
that could negatively influence student learn¬ 
ing (Long et al, 1999). 

In addition, the research raise important is¬ 
sues on the evaluation of college teaching. Even 
though several researchers such as Braskamp 
and Ory (1994), Centra (1993), Marsh (1984, 
1982, 1980) and Marsh and Dunkin (1992), 
Menges and Brinko (1986) and others, have 
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ir interpretuojant destymo reitingo, pateikto 
studentij, rezultatus. Taciau sis jvertinimas 
nesutampa su tyrimais, nes jame pasikliauta 
beveik vien tik studentij pateiktais destymo 
reitingais, neatsizvelgus j kontekstcj ir apribo- 
jimus. Todel kyla abejoniq, ar toks jvertini¬ 
mas gali pagrjstai atspindeti destymo kokyb^. 
Kai jvertinimo rezultatai naudojami fakulte- 
tams ir kitiems padaliniams lyginti, destytojo 
darbo kokybe gali buti netinkamai prista- 
toma. Tai rimta problema, nes, R. E. Stake 
(1999) teigimu, kokybe yra jvertinimo esme. 
„{vertinimas pirmiausia yra privalumij ir tru- 
kumij bei kokybes ieskojimas“ (Stake, 1999, 
p. 1). Gera ataskaita turi atspindeti vertina- 
mojo objekto kokyb^, siuo atveju - destymo 
kokyb^. Tai ypac svarbu, kai jvertinimas gali 
buti kij nors zeidziantis ir isvados turi jtakos 
destytojij ir studentij gyvenimams. 

Pasirinktas naturalistinio stebejimo me- 
todas itin naudingas, nes leido geriau suprasti 
konteksto, kuriame vyksta destymas, kom- 
pleksiskumq ir atskleisti aspektus, galincius 
neigiamai paveikti destymo ivertinimtj. Jei- 
gu vertindami destymo kokyb^ universitetai 
daugiausiai demesio skiria studentij pateik- 
tiems reitingij rezultatams ir ignoruoja kitus 
vertinimo saltinius, destymo kokybe gali buti 
interpretuojama klaidingai. Be to, butina tirti 
kontekstcj, norint teisingai perprasti studentij 
destymo kokybes reitingus ir interpretuoti is 
kitij saltinnj gautcj informacijcj apie destymo 
kokyb^. 

Nathanas nenukentes, net jeigu jo des¬ 
tymas jvertintas klaidingai, bet kiti destyto- 
jai gali buti labiau pazeidziami, ypac jeigu 
sprendziamas jij pareigij klausimas. Be to, is 
interviu su dviem panasij kursij destanciais 
destytojais ir dviem ne koledzo administrate - 
riais paaiskejo, kad ir kitij universitetij fakul- 
tetij darbuotojai bei administratoriai gali su- 
sidurti su panasiomis problemomis, susijusicj 
su zmoniij jvairove auditorijoje. 


written recommendations and limitations 
when using and interpreting results from stu¬ 
dent ratings of instruction, the evaluation is not 
consistent with the research in the field because 
it tended to rely mainly only on student ratings 
for evaluating teaching without considering its 
limitations and context. 

This brings a concern about the validity of 
the evaluation for representing teaching quality. 
When the evaluation results are used to make 
comparisons between faculty across campuses 
and departments, the quality of an instruc¬ 
tor teaching can be misrepresented. This is an 
important issue because as Stake (1999) men¬ 
tions, quality is the essence of an evaluation. 
“Evaluation is first the search for merit and 
shortcoming, for quality.” (Stake, 1999, p.l). A 
good evaluation has to be able to represent the 
quality of the evaluand, in this case the qual¬ 
ity of an instructor s teaching. This is especially 
important when the evaluation is hurtful and 
inferences that affect instructors and students 
lives are made. 

The selection of a naturalistic method of 
inquiry used in this study was especially use¬ 
ful for enhancing our understanding about 
the complexity of the teaching context and of 
important aspects that could negatively affect 
the evaluation of an instructor teaching. The 
emphasis put by the institution on student 
rating results as a single source for evaluating 
teaching without considering the importance 
of other sources can lead to misrepresenta¬ 
tions about the quality of instruction. In ad¬ 
dition, analyzing the context is essential for 
understanding the meaning of student ratings 
and other sources of information about teach¬ 
ing quality. 

Although Nathan is in a special situation 
that prevents him from getting hurt if his 
teaching is misrepresented, other faculty such 
as those under tenure-track may be in a vul¬ 
nerable situation. In addition, our interview 
of two instructors teaching a similar course 
and two administrators outside the college 
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of education, provided us with evidence that 
other faculty and administrators may be fac¬ 
ing similar issues while addressing diversity in 
the classroom. 
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